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(54) Camera control system 

(57) A camera control system is arranged to 
improve operabilHy of at least a camera or each of a plu- 
rality of cameras for panning and tilting control over the 
camera by permitting simultaneous confirmation of the 
photo-taking postures of the camera in the direction of 
tilting as well as in the direction of panning. The opera- 
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bility is improved by arranging a tilt control panel to be 
displayed to permit control in the tilting direction of the 
camera when a camera icon indicative of the camera is 
selected on a map displayed at a monitor. 



? 




18 

\ 


20-1 




18-1 


MONITOR 




IMAGE RECEIVING 
TERMINAL 


20-2 

\ 




18-2 

\ 


MONITOR 




IMAGE RECEIVING 
THRU IN AL 



12 
\ 

1Z-1 



14 



14-1 



T- 

16-1 



TERMINAL 



12-2 



NETWORK 



20-in 



unNiTOpU— im£ RECEIVING 
MONITOR] yg^i^ 



18-s' 



IMAGE TRANSMITTING 
TERMINAL 



n. 



_ IMAGE TRANSMITTING 
TERMINAL 



. I_ . 

m CAMERA CONTROL 
m DEVICE 


_ VIDEO 
~ CAMERA 


I 


14-2^ 


16-2-^ 


. CAMERA CONTROL ^ 
DEVICE 


_ VIDEO 
CAMERA 


1 


! 14-n 

1 ) 


16-n 

) 


CAMERA CONTROL „ 
DEVICE 


m VIDEO 
CAMERA 



Prlntnrl hi/ Yorro tl tt(\ RitcfnACC Qor™/-^o 



1 



EP0884 909A2 



2 



Description 

BACKGROUND OF THE INVENTION 

Field of the Invention s 

The present invention relates to a camera control 
system, etc.. adapted for a surveillance camera or a 
video conference system which is communicating infor- 
mation, for example, through a network. 10 

Descrpbon of Related Art 

A remote surveillance system using a plurality of 
cameras has heretofore been arranged to use several 15 
video cameras, to obtain analog video signals from 
these video cameras and to supply the analog video 
signals to a plurality of monitors arranged at a managing 
apparatus. The remote surveillance system of this kinds 
has been used within a relatively small building. 20 

MeanwtWe. a larger remote surveillance system in 
which a pbrakty of cameras are connected to an LAN 
(local area network) or a public cfgrtal network such as 
an I SON Integrated services digital network) has been 
developed to permit a greater number of cameras 25 
including cameras located at far distances to be con- 
nected to the system 

Camera control systems capable of controlling the 
cameras of such a remote suvedance system through 
a network ndufe a camera control system which is 30 
arranged to enatte each camera operating terminal to 
display images and 10 perform camera control through a 
GUI (graphcal user ntertace) operation by utilizing an 
apparatus such as a personal computer or a worksta- 
tion 35 

An advantage of tie above-stated camera control 
system lies tn thai camera control system enables 
any person who « unaccustomed to the apparatus to 
easily handle the tpparatus The operability of the cam- 
era control system can be enhanced particularly by 40 
arranging the camera control system to simultaneously 
show a display on a monitor of an image picked up by a 
camera and also a camera control panel provided for 
control over the camera from which the image is output- 
ted. 45 

Another advantage o< the camera control system 
lies in that a plurality of cameras connected to the net- 
work can be vtsuaty controted by using a map which 
shows thereon allocations of t>e cameras and camera 
icons indicative of the image pickup directions of the so 
cameras 

However, the map showing the allocations of the 
cameras and the camera icons have been arranged to 
show the cameras only in a state of being viewed from 
above. The conventional camera control system is, ss 
therefore, not usable for controlling the postures of the 
cameras in the tilting directions, though it permits con- 
trol in the panning directions of the cameras. 



BRIEF SUMMARY OF THE INVENTION 

The invention is directed to the solution of the 
above-stated problem of the conventional camera con- 
trol system. An object of the invention is, therefore, to 
provide a camera control system which permits control 
over the posture of a camera in the direction of tilting as 
well as in the direction of panning, by using a flatty 
drawn map and camera icons shown on the map. 

To attain the above object, in accordance with an 
aspect of the invention, there is provided a camera con- 
trol system capable of selectively controlling an image 
pickup direction of at least one camera connected to the 
camera control system through a network, which com- 
prises map display means for displaying a map, first 
camera index display means for displaying a first cam- 
era index indicative of a position of the camera in a state 
of being superimposed on the map displayed by the 
map display means, and second camera index display 
means for displaying a second camera index indicative 
of a state of a current tilting direction of the camera in 
relation to the first camera index displayed by the first 
camera index display means. 

Further, to attain the above object, in accordance 
with another aspect of the invention, there is provided a 
control method for a camera control system capable of 
selectively controlling an image pickup direction of at 
least one camera connected to the camera control sys- 
tem through a network, which comprises a map display 
step of displaying a map, a first camera index display 
step of displaying a first camera index indicative of a 
position of the camera in a state of being superimposed 
on the map displayed by the map display step and a 
second camera index display step of displaying a sec- 
ond camera index indicative of a state of a current tilting 
direction of the camera in relation to the first camera 
index displayed by the first camera index display step. 

Further, to attain the above object, in accordance 
with a further aspect of the invention, there is provided a 
storage medium which stores therein a program for 
operating functions of a camera control system capable 
of selectively controlling an image pickup direction of at 
least one camera connected to the camera control sys- 
tem through a network, the program comprising proc- 
esses of displaying a map, displaying a first camera 
index indicative of a position of the camera in a state of 
being superimposed on the map displayed, and display- 
ing a second camera index indicative of a state of a cur- 
rent tilting direction of the camera in relation to the first 
camera index displayed. 

The above and other objects and features of the 
invention will become apparent from the following 
detailed description of an embodiment thereof taken in 
connection with the accompanying drawings. 
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BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF 
THE DRAWING 

Fig. 1 is a block diagram showing the arrangement 
of a camera control system. s 

Fig. 2 is a block diagram showing the arrangement 
of an image transmitting terminal. 

Fig. 3 is a block diagram showing the arrangement 
of an image receiving terminal. 

Fig. 4 is a block diagram showing the software 10 
arrangement of the camera control system. 

Fig. 5 shows by way of example a display made on 
a monitor image plane of an image receiving terminal 
18. 

Fig. 6 shows another example of display made on is 
the monitor image plane of the image receiving terminal 
18 

Fig. 7 shows a further example of display made on 
the monitor image plane of the image receiving terminal 
18. 20 

Fig 8 shows by way of example a display of a cam- 
era icon in process of dragging. 

Fig 9 shows by way of example a display of a cam- 
era icon which is controllable. 

Fig 10 is a flow chart showing a flow of operation 25 
processes of an image receiving terminal to be carried 
out in controlling a camera. 

Fig. 1 1 is a flow chart showing a flow of operation 
processes of an image transmitting terminal to be car- 
ried out upon receipt of an inquiry signal. 30 

Fig. 12 is a flow chart showing a flow of operation 
processes of the image transmitting terminal to be car- 
ried out in controlling a camera. 

Figs. 13(a); 13(b) and 13(c) show examples of dis- 
play made on a tilt display panel. 35 

Fig. 14 shows an example of display made on the 
monitor image plane of the image receiving terminal 18. 

DETAILED DESCRIPTION OF THE INVENTION 

40 

Hereinafter, a preferred embodiment of the inven- 
tion will be described in detail with reference to the 
drawings. 

Fig. 1 is a block diagram showing in outline the 
arrangement of a camera control system according to 45 
the embodiment of the invention. A network 10 is 
arranged to digitally transmit image data and camera 
control information (including status information). An "n" 
number of image transmitting terminals 12 (12-1 to 12- 
n) are connected to the network 10. Each of the image so 
transmitting terminals 12 (12-1 to 12-n) is composed of 
an information processing terminal such as a computer 
or the like. 

Each of video cameras 16 (16-1 to 16-n) is con- 
nected to one of the image transmitting terminals 12 ss 
(12-1 to 12-n) through one of camera control devices 14 
(14-1 to 14-n). Each of the camera control devices 14 
(14-1 to 14-n) is arranged to control panning, tilting, 



zooming, focusing and an aperture of one of the video 
cameras 16 connected thereto, in accordance with a 
control signal from a corresponding one of the image 
transmitting terminals 12 (12-1 to 12-fi). 

Each of the video cameras 16 (16-1 to 16-n) 
receives supply of power from one of the camera control 
devices 14 (14-1 to 14-n). Each of the camera control 
devices 14 (14-1 to 14-n) is arranged to control turning- 
on or tuming-off of the power supplied to the video cam- 
era 16, in accordance with a control signal coming from 
outside. 

Further, Image receiving terminals 18 (18-1 to 18- 
m) which are arranged to receive image information 
sent out to the network 10 from the image transmitting 
terminals 12 (12-1 to 12-n) and to cfisplay the image 
information received are also connected to the network 
10. Monitors 20 (20-1 to 20-m) each of which is com- 
posed of a bit-mapped display or a CRT (cathode-ray 
tube) are connected respectively to the image receiving 
terminals 18 (18-1 to 18-m), 

The network 10 does not have to be a wire network 
but may be a wireless network using a wireless LAN 
device or the like. In the event of such a wireless net- 
work, each of the image receiving terminals 18 can be 
integrated with the monitor 20 into a pdrtable-type 
image receiving terminal. 

Each of the image transmitting terminals 12 is 
arranged to compress an image signal outputted from 
the camera 16 in accordance with a predetermined 
compression method, such as H.261, and to send the 
compressed image signal via the network 10 to an 
image receiving terminal 18 requesting the image or to 
all of the image receiving terminals 18. Each of the 
image receiving terminals 18 is capable of controlling 
turning-on or turning-off of the supply of power as well 
as various parameters, such as a photo-taking direc- 
tion, a photo-taking magnification, focus, an aperture, 
etc., through the network 10, the image transmitting ter- 
minal 12 and the camera control device 14. 

Each of the image transmitting terminals 12 may 
have a monitor connected thereto and may be provided 
with an image expanding device for expanding a com- 
pressed image, so that the image transmitting terminal 
12 can be used also as an image receiving terminal. 
Meanwhile, each of the image receiving terminals 18 
may have the camera control device 14 and the video 
camera 16 connected thereto and may be provided with 
an image compressing device, so that the image receiv- 
ing device 1 8 can be used also as an image transmitting 
terminal. Each of these terminals is provided with a 
ROM which stores therein some software that is neces- 
sary for transmitting or receiving images. 

Fig. 2 is a block diagram showing in outline the 
arrangement of each image transmitting terminal 12. 
The image transmitting terminal 12 is provided with a 
CPU 22 which is arranged to perform overall control for 
the whole image transmitting terminal 12, a main stor- 
age device (RAM) 24, a detachabfy-mountable external 
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storage device 26 such as a floppy disk or a CD-ROM, 
a secondary storage device 28 such as a hard disk, a 
mouse 30 which serves as a pointing device, a key- 
board 32, an I/O board 34 which is connected to the 
camera control device 1 4 to receive camera control sig- 
nals, and a video capture device 36 which is arranged to 
take in a video signal outputted from the video camera 
16. 

The video capture device 36 in the embodiment has 
an A/D converting function to convert an analog video 
signal into a digital signal and an image compressing 
function to compress image information. A video board 
38 is arranged to display image information on a moni- 
tor 40. Reference numeral 42 denotes a network inter- 
face. A system bus 44 is arranged to interconnect the 
component elements 22 to 38 and 42. Further, in a case 
where the image transmitting terminal 12 is arranged to 
be used only fa image transmission, the video board 38 
and the monitor 40 may be omitted. 

With the embodiment arranged as described 
above, the image transmitting terminal 12 transmits an 
image signal via the network 10 to the image receiving 
terminal 18 which is located at a remote place, and also 
receives a camera control signal from the image receiv- 
ing terminal 18. Upon receipt of the camera control sig- 
nal, the image transmitting terminal 12 performs control 
over a panning or tilting action or the like of the camera 
16. 

Fig. 3 is a block diagram showing in outline the 
arrangement of each image receiving terminal 18 which 
is composed of an information processing terminal such 
as a computer or the like. Referring to Fig. 3, a CPU 122 
is arranged to perform control for the whole image 
receiving terminal 18. The image receiving terminal 18 
includes a main storage device (RAM) 124, a detacha- 
bly-mountable external storage device 126 such as a 
floppy disk or a CD-ROM, a secondary storage device 
128 such as a hard disk, a keyboard 132, a mouse 151 
which serves as a pointing device, a video board 138 
which is arranged to display image information on a 
monitor 140, a network interface 142, a compression 
decoder 144 arranged to expand compressed image 
information, and a system bus 146 which is arranged to 
interconnect the component elements of the image 
receiving terminal 18. The mouse 151 is provided with 
click buttons which are disposed on its right and left 
sides, as shown in Ftg. 3. 

The arrangement of the image receiving terminal 
18 is identical with that of the image transmitting termi- 
nal 12, shown in Fig. 2, except that the image receiving 
terminal 18 is provided with the decoder 144 which is 
arranged to expand a compressed image, and the soft- 
ware of the image receiving terminal 1 8 differs from that 
of the image transmitting terminal 12. Therefore, the 
details of the image receiving terminal 18 are omitted 
from the following description. Further, if the image 
receiving terminal 1 8 is provided with the software of the 
image transmitting terminal 12, a video output signal 



can be transmitted from the image receiving terminal 18 
to other video receiving terminals 18. 

The image receiving terminal 18 sends a camera 
control signal to the image transmitting terminal 12. The 

5 image transmitting terminal 1 2 which receives the cam- 
era control signal controls the camera 16 according to 
the camera control signal and then sends information 
on the current state of the camera 16 back to the image 
receiving terminal 18. Upon receipt of the image data 

io from the image transmitting terminal 12, the image 
receiving terminal 18 processes the image data in a 
predetermined manner and displays a picked-up image 
on the monitor 140 in real time. 

Fig. 4 shows the software arrangement of the cam- 

15 era control system in the embodiment Referring to Fig. 
4, the image receiving terminal 18 is provided with a 
camera controlling client (software) 50, connected to 
the image transmitting terminal 12 through the network 
10, for remotely controlling the camera 16, image 

20 receiving software 52 for expanding compressed image 
data received from the image transmitting terminal 12 
and displaying the image on the image plane of the 
monitor, map managing software 54 for displaying the 
allocation and the current state of each camera 16 in a 

25 camera symbol on a map. The software is stored in the 
secondary storage device 128 of the image receiving 
terminal 18. 

The image receiving software 52 is arranged to 
manage the cameras 16 connected to all of the image 

30 transmitting terminals connected to the network 1 0. The 
image receiving software 52 holds information on fixed 
matters and information on variable matters, such as 
the name of the camera 16, the host name of the com- 
puter to which the camera 16 is currently connected, 

35 various states of the camera 16 including panning, tilt- 
ing and zooming, whether or not the camera 16 is con- 
trollable, which of the cameras 16 is being currently 
controlled, which of the cameras 16 is picking up an 
image currently on display, etc. Such information is sup- 

40 plied to the camera control client 50 and the map man- 
aging software 54 to be used for updating the display of 
a camera symbol, etc. 

The image transmitting terminal 12 includes a cam- 
era controlling server (software) 56 and image transmit- 

45 ting software 58, which are stored in the secondary 
storage device 28. The camera controlling server (soft- 
ware) 56 is arranged to control the camera 16 through 
the camera control device 14 in accordance with a 
request from the camera control client 50 and to send 

so information on the current state of the camera 16 (on 
how the camera is now being used, etc.) to the source 
of request The image transmitting software 58 is 
arranged to compress an image outputted from the 
camera 16 and to send the compressed image to the 

55 source of request in a prescribed form via the network 
10. 

Fig. 5 shows an example of the contents of a dis- 
play made on an image plane of the monitor of the 



c 



EP0 884 909 A2 



c 



image receiving terminal 18. Referring to Fig. 5, refer- 
ence numeral 60 denotes a map window which shows in 
each map a layout of offices, stores, shops, ware- 
houses, or the like, in which a plurality of cameras 16 
are allocated. A plurality of maps 60a, 60b, 60c and 60d 5 
are arranged to be selectively used in the map window 
60. The number of maps 60a, 60b, 60c, 60d, — that can 
be displayed on the map window 60 is not particularly 
limited, as it depends on the performance of the system. 

Tags are attached respectively to the maps 60a, 10 
60b, 60c and 60d as shown in Fig. 5. One of the maps 
can be selected by moving a cursor 80 with a mouse 
151 and by clicking the mouse 151 at the tag of a 
desired map. Then, the selected map is displayed on 
the front side of the map window 60. In the case of Fig. 75 
5, the map 60b is displayed in the front. In the map 60b, 
there are shown camera icons 62a, 62b, 62c and 62d 
which indicate the allocated cameras. If it is desired to 
change the display on the map window 60 to the map 
60c. the tag of the map 60c is selected and the mouse 20 
1 51 is clicked there. This causes the map 60c to be dis- 
played as shown in Fig. 6, so that camera icons 62e and 
62f which correspond to two allocated cameras are 
shown. These camera icons 62a, 62b, 62c, 62d, 62e 
and 62f are displayed respectively as being directed to 25 
the photo-taking directions of the corresponding cam- 
eras 16. Fig. 5 shows also an image display window 64 
which is provided with image display areas 66a to 66f at 
which images picked up by the cameras 16 are respec- 
tively displayed. 30 

The operation processes of the camera control sys- 
tem in the present embodiment are described below 
with reference to Figs. 10, 11 and 12 which are flow 
charts. A program for control to be performed on the 
side of the image receiving terminal 18 is stored in the 35 
secondary storage device 128. In carrying out the pro- 
gram, the program is loaded on the main storage device 
124 and is executed by the CPU 122. A program for 
control to be performed on the side of the image trans- 
mitting terminal 12 is stored in the secondary storage 40 
device 28. In carrying out the program, the program is 
loaded on the main storage device 24 and is executed 
by the CPU 22. 

Fig. 10 is a fbw chart showing the processes to be 
performed on the side of the image receiving terminal 45 
18. At a step S101, when it is desired to display an 
image picked up by one of cameras 1 6, the camera icon 
62 which represents the camera 16 is selected on an 
applicable map of the map window 60 by the user (oper- 
ator). Then, the user performs a drag-and-drop opera- so 
tion with the mouse to drag, superimpose and drop the 
selected camera icon 62 on one of the image display 
areas 66a to 661 

For example. Fig. 7 shows a case where the cam- 
era icon 62c is dragged and dropped on the image dis- ss 
play area 66c. In this case, an image picked up by the 
camera 16 which is represented by the camera icon 62c 
is displayed in the image display area 66c. Further, in 



the case of the embodiment, the display shape of the 
camera icon 62c is changed, while it is dragged, to 
show that the camera icon 62c is in process of dragging, 
as shown in Fig. 8. 

At a step S102, when the above-stated action is 
performed, the camera controlling client 50 sends, to 
the camera server 56 of the image transmitting terminal 
12 corresponding to the operated camera icon 62c, a 
request signal for image data and an inquiry signal as to 
whether this camera is controllable. The flow of opera- 
tion then proceeds to a step S201 of Fig. 1 1 . 

Fig. 1 1 is a flow chart showing the operation proc- 
esses to be performed on the side of the image trans- 
mitting terminal 12 when the request signal and the 
inquiry signal are received from the image receiving ter- 
minal 18. At the step S201 of Fig. 1 1, a check is made 
to find if the request signal and the inquiry signal are 
received. If so, the flow of operation proceeds to a step 
S202. At the step S202, the camera controlling server 
56 of the image transmitting terminal 12 sends image 
data and information on the current state of the camera 
16, such as the current state of use of the camera 16 
and the photo-taking direction of the camera 16, to the 
image receiving software 52 of the image receiving ter- 
minal 18. The flow then proceeds to a step S103 of Fig. 
10. 

Referring again to the flow chart of Fig. 10, at the 
step S103, the image receiving software 52 of the 
image receiving terminal 18 receives the information on 
the current state of the camera and image data from the 
image transmitting terminal 12. The image receiving 
software 52 then causes an image display to be made 
on the basis of the image data in the image display area 
66 on which the camera icon 62 is dropped. 

The map managing software 54 then adjusts the 
direction of the selected camera icon 62 to the shooting 
(photo-taking) direction of the applicable camera 16. In 
addition to that a scope 72 is displayed for the selected 
camera icon 62, as shown in Fig. 9, to indicate that the 
image picked up by the camera is currently on display. 

At the next step S104, a check is made to find if the 
camera is controllable, ff so, the flow proceeds to a step 
$105 to display a control pointer 74 for control over a 
panning or zooming action within the scope 72. When 
the control pointer 74 is dragged with the mouse 1 51 (by 
operating the mouse 151 with the left side button of the 
mouse 151 kept in a clicked state), the camera control- 
ling client 50 is enabled to perform control over the pan- 
ning or zooming action according to the direction in 
which the dragging operation is performed. 

At a step S106, with the camera judged to be con- 
trollable; a check is made to find if the right side button 
of the mouse 151 is clicked for the camera icon 62 while 
selection is in process. If so, the flow proceeds to a step 
S107. At the step S107, a tilt control panel 161 which is 
provided for tilt control, i.e., control over a tilting action, 
is displayed as shown in Fig. 13(a). The tilt control panel 
161 may be displayed either in an adjacent position on 
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one side of the right-button clicked camera icon 62 or at 
a position designated beforehand by the operator. 

Referring to Fig. 13(a), a camera icon 163 in the titt 
control panel 161 represents one side of the applicable 
camera 16. The camera icon 163 shows the camera 16 
in a shooting state in the current tilting direction. A scroll 
bar 166 is displayed below the camera icon 163. The 
camera controlling client 50 is allowed to form a tilt con- 
trol command by moving a knob 167 on the scroll bar 

166 according to the direction in which the mouse 151 is 
dragged. 

When the knob 167 of the scroll bar 166 is moved 
upward on the scroll bar 166 by the dragging operation 
on the mouse 151, the map managing software 54 
causes the camera icon 163 in an interlocked manner to 
be displayed in an upward directed posture according to 
the dragging operation, as shown in Fig. 13(b). If the 
knob 167 of the scroll bar 166 is moved downward by 
the dragging operation, the camera icon 163 is dis- 
played in a downward directed posture as shown in Fig. 
13(c). 

In Figs. 13(a). 13(b) and 13(c), mark "XX" 164 rep- 
resents an upper limit angle value of tilting, and mark 
"YY" 165 represents a lower limit angle value of tilting. 
These limit values either may be the angle values or 
may be replaced with some other suitable values. 
These values are obtained by sending, at the above- 
stated step S102. a request for tilting angle limiting posi- 
tions of the camera 1 6 from the camera controlling client 
50 through the network 10 to the camera controlling 
server 56 of the image transmitting terminal 12 to which 
the applicable camera 1 6 is connected. 

Mark "nn" shown in the neighborhood of the knob 

167 denotes the current tilt position in a numerical 
value When the dragging operation is performed on the 
knob 167 of the scroll bar 166, this numerical value var- 
ies according to the movement of the knob 167. When 
the knob 167 reaches the upper limit of the scroll bar 
166. the value of the mark "XX" 164 becomes equal to 
the numerical value of the scroll bar 166. Conversely, 
when the knob 167 reaches the lower limit of the scroll 
bar 166, the value of the mark "YY" 165 becomes equal 
to the numerical value of the scroll bar 166. The opera- 
tor can perform tilting control to attain a desired position 
by watching this value. 

It is also possible for the camera controlling client 
50 to form a tilt control signal by dragging (by causing to 
move with a dragging operation on the mouse) the con- 
trol pointer 162 within the scope of the camera icon 163 
upward or downward. In this instance, the map manag- 
ing software 54 causes the display shape of the camera 
icon 163 to be changed according to the controlled tilt 
shooting direction as shown in Figs. 13(a), 13(b) and 
13(c). Then, in association with this change, the display 
position of the knob 167 of the scroll bar 166 is also 
changed accordingly. Further, in a case where the con- 
trol pointer 162 is dragged to the right or to the left, the 
camera controlling client 50 forms a control instruction 



for a zoom magnification. 

At a step S1 08, the camera control signal formed by 
the camera controlling client 50 through the above- 
stated process is sent to the image transmitting terminal 

5 1 2. The flow then proceeds to a step S203 shown in Fig. 
12. Further, in the case of the embodiment, the tilt con- 
trol panel 162 is arranged to simultaneously display the 
camera icon 163 and the scroll bar 166 as shown in Fig. 
13(a). However, it is also possible to carry out tilting con- 
ic trol over the camera 16 by displaying only one of the 
camera icon 163 and the scroll bar 166. In such a mod- 
ification, the camera controlling client 50 is arranged to 
form a tilting control signal also in the same manner as 
described above. 

75 As mentioned in the foregoing, the map managing 
software 54 is arranged to always receive, from the 
image receiving software 52, information on changes 
(taking place in panning and tilting) of the camera 16 
picking up an image currently on display even when 

20 control is impossible. In accordance with this informa- 
tion, the map managing software 54 changes the direc- 
tion of the camera icon 62 to adjust it to the shooting 
direction of the camera 16 which picks up the image 
currently on display. 

25 Further, the embodiment is arranged to permit the 
tilt control panel 161 to be displayed only when the cam- 
era is judged to be controllable. That arrangement how- 
ever, can be changed to permit the tilt control panel 161 
to be displayed by clicking the right button of the mouse 

so 151 even when the camera 16 is judged to be not con- 
trollable. This modification has an advantage in that the 
shooting direction in the tftting direction on display can 
be confirmed on the basis of information on the current 
state of the camera 16 obtained from on the side of the 

35 image transmitting terminal 12. In that instance, the 
control pointer 162 for the uncontrollable camera is not 
displayed. 

Fig. 12 is a flow chart showing the operation proc- 
esses to be carried out on the side of the image trans- 

40 mitting terminal 12 in controlling the camera 16. At the 
step S203 of Fig. 12, a check is made to find if the cam- 
era control signal is received from the image receiving 
terminal 18. If so, the flow proceeds to a step S204. At 
the step S204, the camera controlling server 56 controls 

45 the camera 1 6 on the basis of the camera control signal. 
At the next step S205, information on the current state 
of the camera 16 obtained through the control is sent to 
the map managing software 54 of the image receiving 
terminal 18. After that the flow proceeds to a step 

so S108aof Fig. 10. 

Referring again to the flow chart of Fig. 10, at the 
step S108a, the shape of the camera icon 62 on the 
map window 60 is changed on the basis of the informa- 
tion on the current state of the camera 16 received from 

55 the camera controlling server 56. At the next step S1 09, 
a check is made to find if the control over the camera 
and the display of an image picked up by the camera 
are to be brought to an end. If so, a drag-anddrop oper- 
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ation is carried out to drag and bring the area 66 where 
the image is displayed to a trash can icon 67, as shown 
in Fig. 14. 

In a case where images picked up by a plurality of 
cameras corresponding to camera icons 62 shown on a s 
map are already displayed on the image display panel 
64 and rt is desired to change a camera to be controlled 
among the plurality of these cameras, the mouse 1 51 is 
operated to move the cursor 80 either to one of the cam- 
era icons 62 displayed on a map corresponding to the 10 
camera to be newly controlled or to one of the image 
display areas 66, and the left button of the mouse 1 51 is 
clicked. 

For example, in a case where it is desired to change 
a controlling object from one of the cameras 16 which 75 
corresponds to the image display area 66c over to 
another camera which corresponds to the image display 
area 66a, the left button of the mouse 151 is clicked 
either at the image display area 66a or at the camera 
icon 62a. Then, the camera controlling client 50 sends 20 
an inquiry signal to the camera controlling server 56 of 
the image transmitting terminal 12 which corresponds 
to the selected camera icon 62 to inquire whether the 
camera 16 is controllable. In replay to the inquiry signal, 
the camera controlling server 56 sends to the image 25 
receiving terminal 18 information on the camera 16 
which corresponds to the current image display area 
66a as to whether it is controllable or not controllable 
because of some reason, such as that the camera is 
being controlled by some other operator, ff the camera 30 
is judged to be controllable, the display position of the 
control pointer 74is shifted from the camera icon 62c to 
the camera icon 62a. 

In case where H is desired to control the tilt of the 
camera 16, the camera icon 62a is selected and the 35 
right button of the mouse 151 is clicked. Then, the tilt 
control panel 161 is displayed as shown in Fig. 13(a). 
The tift control can be accomplished by performing a 
dragging operation on the control pointer 162 in the 
same manner as described in the foregoing. 40 

As mentioned above, in a case where it is desired to 
perform a tilting operation on a camera icon displayed 
on a map, the tilt control panel 161 can be displayed by 
clicking the right button of the mouse 151 at the camera 
icon. Therefore, the shooting directions of each camera 
including the panning, tilting and zooming directions can 
be controlled at the same time while confirming on the 
map the shooting point of the camera under control. 
Further, in accordance with the invention, a camera 
control system thus can be arranged to permit simulta- so 
neous confirmation of the panned and tilted shooting 
directions of the camera. 

The object of the invention can be attained also by 
providing a system or an apparatus with a storage 
medium on which software program codes are recorded 55 
for carrying out the functions of the embodiment 
described above. Then, a computer (or a CPU or an 
MPU) included in the system or the apparatus is 



45 



arranged to read and execute the program codes stored 
in the storage medium. 

In the above-stated case, the functions of the 
embodiment disclosed above can be carried out by the 
program codes read out from the storage medium. 
Then, the storage medium in which the program codes 
are stored can be considered to constitute the invention. 

The storage medium to be used for supplying the 
above-stated program codes can be selected, for exam- 
ple, from among storage media such as a floppy disk, a 
hard disk, an optical disk, a magneto-optical disk, a CD- 
ROM, a CD-R, a magnetic tape, a nonvolatile memory 
card and a ROM. 

Further, with the program codes read out executed 
by a computer, it is possible not only to allow the compu- 
ter to carry out the functions of the embodiment dis- 
closed but also to aflow an OS (operating system) 
working on the computer to execute a part of or all of 
actual processes of the functions. 

Further, after the program codes read out from the 
storage medium are written into a function expanding 
board inserted in a computer or into a memory included 
in a function expanding unit connected to the computer, 
a part of or all of the actual processes of the program 
codes can be executed by a CPU or the like included in 
the function expending board or the function expanding 
unit. The functions of the embodiment disclosed can be 
carried out by such processes. 

In a case where the arrangement of the embodi- 
ment disclosed is applied to the storage medium men- 
tioned above, program codes corresponding to the flow 
charts described in the foregoing are to be stored in the 
storage medium. In short, modules indispensable to the 
camera control system according to the invention are 
stored in the storage medium. 

The indispensable modules include at least "a tilt 
control panel display module" for tilt control over a cam- 
era corresponding to a camera icon displayed by siper- 
imposing it on a map and "a control module" for forming 
camera control commands by an operation on the tilt 
control panel. Program codes of these modules are 
stored in the storage medium. 

According to the arrangement of the embodiment 
disclosed, a camera control system can be arranged to 
permit tilt control over each of video cameras by con- 
firming the current position of the video camera through 
the camera icon which represents the video camera on 
a map window. 

A camera control system is arranged to improve 
operability of at least a camera or each of a plurality of 
cameras for panning and tilting control over the camera 
by permitting simultaneous confirmation of the photo- 
taking postures of the camera in the direction of tilting 
as well as in the direction of panning. The operability is 
improved by arranging a tilt control panel to be dis- 
played to permit control in the tilting direction of the 
camera when a camera icon indicative of the camera is 
selected on a map displayed at a monitor. 
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Claims 

1. A camera control system capable of selectively 
controlling an image pickLp direction of at least one 
camera connected to said camera control system s 
through a network, said camera control system 
comprising: 

map display means fa displaying a map; 
first camera index display means for displaying 10 
a first camera index indicative of a position of 
the camera in a state of being superimposed 
on the map displayed by said map display 
means; and 

second camera index display means for dis- is 
playing a second camera index indicative of a 
state of a current tilting direction of the camera 
in relation to the first camera index displayed by 
said first camera index display means. 

20 

2. A camera control system according to claim 1 , fur- 
ther comprising control means for, in response to 
designating the second camera index displayed by 
said second camera index display means, enabling 
the tilting direction of a camera which corresponds 25 
to the designated second camera index, to be con- 
trolled. 

3. A camera control system according to claim 1, 
wherein said second camera index display means so 
is arranged to display the second camera index in 
response to designating the first camera index. 



A camera control system according to claim 1, 
wherein the second camera index displayed by said 
second camera index display means is an icon, and 
indicates the state of the tilting direction of a cam- 
era which corresponds to said icon. 
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5. A camera control system according to claim 2, fur- 
ther comprising tilting direction display means for, in 
response to designating the second camera index 
displayed by said second camera index display 
means, displaying information on the current tilting 
direction of a camera which corresponds to the des- 45 
ignated second camera index. 

6. A camera control system according to claim 5, fur- 
ther comprising allowable range display means for 
displaying information on a controllable range in the so 
tilting direction of the camera as well as information 

on the current tilting direction of the camera dis- 
played by said tilting direction display means. 



7. A camera control system according to claim 6, 
wherein said allowable range display means is 
arranged to display information on the controllable 
range of the camera by using a scroll bar, and said 
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tilting direction display means is arranged to display 
on the scroll bar an index indicative of a current 
image pickup direction of the camera. 

8. A camera control system according to claim 7, 
wherein said control means is arranged to enable 
the tilting direction of the camera to be controlled in 
response to designating and moving the index dis- 
played by said tilting direction display means. 

9. A camera control system according to claim 8, 
wherein the second camera index displayed by said 
second camera index display means indicates the 
tilting direction of the camera in association with 
movement of the index displayed by said tilting 
direction display means. 

10. An information processing terminal comprising: 

output means for outputting, to a terminal hav- 
ing map display means for displaying a map, 
first camera index display means for displaying 
a first camera index indicative of a position of 
the camera in a state of being superimposed 
on the map displayed by said map display 
means and second camera index display 
means for displaying a second camera index 
indicative of a state of a current tilting direction 
of the camera in relation to the first camera 
index displayed by said first camera index dis- 
play means, information on the state of the tilt- 
ing direction of the camera so as to display the 
second camera index, via a network 

11. A control method for a camera control system capa- 
ble of selectively controlling an image pickup direc- 
tion of at least one camera connected to said 
camera control system through a network, said 
control method comprising: 

a map display step of displaying a map; 
a first camera index display step of displaying a 
first camera index indicative of a position of the 
camera in a state of being superimposed on 
the map displayed by said map display step; 
and 

a second camera index display step of display- 
ing a second camera index indicative of a state 
of a current tilting direction of the camera in 
relation to the first camera index displayed by 
said first camera index display step. 

12. A control method according to claim 11, further 
comprising a control step of, in response to desig- 
nating the second camera index displayed by said 
second camera index display step, enabling the tilt- 
ing direction of a camera which corresponds to the 
designated second camera index, to be controlled. 



15 



c 



EP0 884 909 A2 



c 



10 



15. 



15 



13. A control method according to claim 11, wherein 
said second camera index display step is arranged 
to display the second camera index in response to 
designating the first camera index. 

14. A control method according to claim 11, wherein 
the second camera index displayed by said second 
camera index display step is an icon, and indicates 
the state of the tilting direction of a camera which 
corresponds to said icon. 

A control method according to claim 12, further 
comprising a tilting direction display step of, in 
response to designating the second camera index 
displayed by said second camera index display 
step, displaying information on the current tilting 
direction of a camera which corresponds to the des- 
ignated second camera index. 

A control method according to claim 15, further 20 
comprising an allowable range display step of dis- 
playing information on a controllable range in the 
tilting direction of the camera as well as information 
on the current tilting direction of the camera dis- 
played by said tilting direction display step. 25 

17. A control method according to claim 16, wherein 
said allowable range display step is arranged to dis- 
play information on the controllable range of the 
camera by using a scroll bar, and said tilting direc- 30 
tion display step is arranged to display on the scroll 
bar an index indicative of a current image pickup 
direction of the camera. 
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18. A control method according to claim 17, wherein 35 
said control step is arranged to enable the tilting 
direction of the camera to be controlled in response 

to designating and moving the index displayed by 
said tilting direction display step. 

40 

19. A control method according to claim 18, wherein 
the second camera index displayed by said second 
camera index display step indicates the tilting direc- 
tion of the camera in association with movement of 
the index displayed by said tilting direction display 45 
step. 

20. A control method for an information processing ter- 
minal, said control method comprising: 

so 

an output step of outputting, to a terminal hav- 
ing map display means for displaying a map, 
first camera index display means for displaying 
a first camera index indicative of a position of 
the camera in a state of being superimposed ss 
on the map displayed by said map display 
means and second camera index display 
means for displaying a second camera index 



indicative of a state of a current tilting direction 
of the camera in relation to the first camera 
index displayed by said first camera index dis- 
play means, information on the state of the tilt- 
ing direction of the camera so as to display the 
second camera index, via a network. 

21. A storage medium which stores therein a program 
for operating functions of a camera control system 
capable of selectively controlling an image pickup 
direction of at least one camera connected to the 
camera control system through a network, said pro- 
gram comprising processes of: 

displaying a map; 

displaying a first camera index indicative of a 
position of the camera in a state of being super- 
imposed on the map displayed; and 
displaying a second camera index indicative of 
a state of a current tilting direction of the cam- 
era in relation to the first camera index dis- 
played. 

22. A storage medium according to claim 21, wherein 
said program further comprises a process of, in 
response to designating the second camera index 
displayed, enabling the tilting direction of a camera 
which corresponds to the designated second cam- 
era index, to be controlled. 

23. A storage medium according to claim 21 , wherein 
said program further comprises a process of dis- 
playing the second camera index in response to 
designating the first camera index. 

24. A storage medium according to claim 21, wherein 
said program further comprises a process of caus- 
ing the displayed second camera index to indicate 
the tilting direction of a camera which corresponds 
to the second camera index. 

25. A storage medium according to claim 24, wherein 
said program further comprises a process of, in 
response to designating the second camera index, 
displaying information on the current tilting direction 
of a camera which corresponds to the designated 
second camera index. 

26. A storage medium according to claim 25, wherein 
said program further comprises a process of dis- 
playing information on a controllable range in the 
tilting direction of the camera as well as information 
on the current tilting direction of the camera dis- 
played. 

27. A storage medium according to claim 26, wherein 
said program further comprises processes of dis- 
playing the controllable range of the camera by 
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using a scroll bar and of displaying on the scroll bar 
an index indicative of a current image pickup direc- 
tion of the camera. 

2a A storage medium according to claim 27, wherein 5 
said program further comprises a process of ena- 
bling the tilting direction of the camera to be control- 
led in response to designating and moving the 
index displayed on the scroll bar. 

10 

29. A storage medium according to claim 28, wherein 
said program further comprises a process of caus- 
ing the second camera index displayed to indicate 
the tilting direction of the camera in association with 
movement of the index displayed on the scroll bar. is 

30. A storage medium which stores therein a program 
for operating functions of an information processing 
terminal, said program comprising a process of: 

20 

outputting, to a terminal having map display 
means for displaying a map, first camera index 
display means for displaying a first camera 
index indicative of a position of the camera in a 
state of being superimposed on the map dis- 25 
played by said map display means and second 
camera index display means for displaying a 
second camera index indicative of a state of a 
current tilting direction of the camera in relation 
to the first camera index displayed by said first 30 
camera index display means, information on 
the state of the tilting direction of the camera so 
as to display the second camera index, via a 
network. 
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